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^ Airport departure operations constitute an important source of airline delays 

and passenger frustration. Excessive surface traffic is the cause of increased 
controller and pilot workload; It is also the source of increased emissions; It 
worsens traffic safety and often does not yield improved runway throughput. 
I""! Acknowledging this fact, this paper explores some of the feedback mechanisms 

by which airport traffic can be optimized in real time according to its current 
^0 degree of congestion. In particular, it examines the environmnetal benefits 

x/l that improved surveillance technologies can bring in the context of gate- or 

, ^ , spot-release aircraft strategies. It is shown that improvements can lead yield 

4% to 6% emission reductions for busy airports like New- York La Guardia or 
T-H Seattle Tacoma. These benefits come on top of the benefits already obtained 

^ by adopting threshold strategies currently under evaluation. 

^ 1 Introduction: Lean airport operations mean 

fewer aircraft on the taxiways 

O 
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1.1 Air traffic growth and airport congestion 



The U.S. National Airspace System (NAS) is expected to grow about 2.4% per 
year over the next 20 years and accommodate around 1.6 times today's traffic 
X level by 2028 [T1HI1I1]. The anticipated growth of air traffic is expected to bring 

^ additional concerns to an already congested system [SJ|S]. In particular, airports 

constitute one of the major obstacles to the growth of air traffic. Even though 
the development of smaller regional airports is expected, it is predicted that 
major airports will keep running at full capacity [2]. In some cases, airports 
will not be able to expand their capacity sufficiently to meet the increasing 
demand. Airports like New- York LaGuardia will be physically restrained by 
the lack of space for new runways or ramps. Other airports will not be able to 
grow physically because of significant opposition from local communities. 



*Burgain is with Metron Aviation, Inc, pburgainSgniail.com. Feron is with the Georgia 
Institute of Technology, feron@gatech.edu. This work was funded by Thales Air Operations. 
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1.2 Environmental impact of airports 

The contribution of aviation to CO2 and NOx emissions around airports is ex- 
pected to increase significantly by 2025 and beyond [71 [5] ■ Hence, environmental 
impacts are expected to be the fundamental constraint on air transportation 
growth [3]. Indeed, concerns over pollution have forced governmental, envi- 
ronmental, and regulatory agencies to start implementing emissions abatement 
procedures at certain airports, such as La Guardia ^U\. Starting in 2012, in the 
European Union, CO2 emissions will be capped at the average 2004/2006 levels. 
This will concern all flights arriving at, and departing from, European airports. 
In the United States, Section 231 of the Clean Air Act gives the Environmen- 
tal Protection Agency (EPA) the authority to regulate aircraft emissions, and 
to adopt emissions standards for U.S. -flagged aircraft [11]. Additionally, many 
efforts are being conducted towards emissions-reduction technologies and con- 
cepts, such as electric taxi, with new operational procedures expected to provide 
the greatest near-term beneflts [S] . On the ground, the level of environmental 
nuisance can be directly tied to the number of aircraft whose engines are run- 
ning at any given time. These aircraft are typically those in the taxi phase. 
Thus, the fewer aircraft taxiing on the airport surface at any time, the lower 
the environmental impact of the airport. 

1.3 Current initiatives for improving departure operations 

To tackle this environmental issue, the NextGen concept of operations [2] en- 
courages research in surface traffic operations aimed at lowering emissions and 
improving surface traffic planning. Likewise, according to [H], EUROCON- 
TROL is currently fine-tuning the Airport Collaborative Decision Making De- 
parture Manager (CDM DMAN) concept of operations and is preparing the nec- 
essary implementation guidelines. DMAN incorporates Collaborative Decision- 
Making (CDM) as a tool for managing departure operations. DMAN "keeps the 
number of aircraft on the taxiway at an optimal level" and "keeps the taxiways 
open for other traffic without blocking stands for arrivals, reduces controller 
workload, improves punctuality and predictability, facilitates co-operation be- 
tween aerodrome ATC, airlines and airport operators, enhances CFMU [i.e. 
Central Flow Management Unit slot-revisions] and slot compliance, and exploits 
the departure capacity of the respective runway" JJJ . 

1.4 Analytic research efforts 

The fundamental observation supporting most recent research efforts is the ex- 
istence of a close relationship between the number of aircraft buffered between 
the gate and the runway, and the runway throughput. First observed experi- 
mentally by Shumsky [13j, the runway throughput grows with the number of 
aircraft buffered between the gates and the taxiway; however, the throughput 
saturates past a given level of surface congestion, as shown in Fig. [l] From 
this observation, a number of steps followed: In [T^, Feron et al. discuss the 
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Figure 1: Airport throughput as a function of surface congestion [T31 p. 82]. An 
asterix indicates the mean number of take-offs. Each vertical bar is the range 
from first to third quartile. Note how airport throughput tends to saturate 
when the number of aircraft taxiing-out exceed about 15. The airport is Boston 
Logan. 

creation of a virtual queue to control aircraft access to the taxiway system, 
while respecting the first-come, first-serve rule that dominates air traffic man- 
agement. Pujet et al. |15j develop a detailed queuing model of airport departure 
operations and introduce a simple windowing scheme similar to internet's Trans- 
mission Control Protocol (TCP) to regulate departures: Pushbacks are allowed 
only to the extent that the number of aircraft present on the taxiway system 
(the buffer), does not exceed a given threshold. Later, Carr et al. |TB] describe 
an approach for modeling and controlling queueing dynamic under severe flow 
restrictions and Idris et al. [17] develop a queueing model for taxi-out time esti- 
mations. Recent developments include [H], which details the potential benefits 
of intra-airline slot-swapping inside the virtual departure queue. Finally, two 
notable efforts have led to field implementations of virtual queueing concepts. 
In |19| , Balakrishnan and her co-workers describe the experimental implementa- 
tion of a congestion control scheme by means of windowing of the type proposed 
in |15j and reports significant actual fuel savings and emission reductions: Ac- 
cording to |19) . the fuel savings are of the same order of magnitude as those 
generated by Continuous Descent Approaches. The project CDM@CDG (see 
http://www.euro-cdm.org/library/airports/cdg/) has initiated the implemen- 
tation of a departure manager for Charles de Gaulle Airport, whose purpose 
is to reduce airport surface congestion due to departing traffic. Reportedly, 
the virtual queueing effectively created is leveraged by airlines to perform the 
departure swaps studied in [TBI . 
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1.5 New Surface Surveillance Information 

The gate- and spot-release control efforts described above can be easily imple- 
mented by means of existing technology. Indeed, the only information needed for 
implementation is already available in various forms, including ACARS (Aircraft 
Communications Addressing and Reporting System), for which commercial de- 
coding systems are now available. What motivates this paper, however, is that 
airports become progressively equipped with modern, digital surface surveil- 
lance technologies, such as the Airport Surface Detection Equipment, model X 
(ASDE-X). With such systems, accurate aircraft ground position information 
becomes more easily available in real-time [501 [SI US] • Primarily designed 
for improved surface operations safety, the impact of these systems on the re- 
duction of runway incursion incidents and conflicts has been the focus of several 
studies [241 123 El- 

Other studies, however, also focus on the impact of advanced surface surveil- 
lance on airport efficiency, for example to precisely control taxiing aircraft 
and increase the efhciency of active runway crossings |27| . Early experiments 
show significant operational improvements enabled by airport surface surveil- 
lance technologies. Howell et al. [28], for example, directly measure the impact 
of surveillance data sharing on surface operations at Memphis International 
Airport and at Metropolitan Wayne County Airport. They show that surface 
surveillance data made available to ground controllers directly lead to shorter 
taxi times. At Memphis airport, average taxi time is reduced by 6.6 percent 
during Visual Approach conditions (visibility greater than five miles and ceil- 
ing greater than 5000 feet) , and by 17.5 percent during Instrument Approach 
conditions. In another field study, [5S] Howell et al. take advantage of a surface 
surveillance outage to examine its impact on airline operations. They measure 
changes in taxi-out times, queue lengths, and departure rates before, during, 
and after the outage. They find that, for similar levels of airport surface queues, 
surface surveillance decreases taxi-out times. Furthermore, recent work inves- 
tigates the practical integration of surface surveillance for aircraft arrivals in a 
collaborative environment [301 1311 ISlj ■ 

1.6 Contributions of this paper 

The studies described above leave open, however, the analytical evaluation of 
the impact of these improved surveillance technologies on gate- and spot-release 
strategies. With vast amounts of data about aircraft position now available 
in real-time, it is legitimate to wonder whether the performance of gate-release 
strategies can be improved using these data. Intuitively, this should be the case: 
A cluster of five departing aircraft near the runway threshold should prompt 
decisions that differ from those required if the same cluster of five departing 
aircraft has just left their gate. The two situations, however, are considered to 
be equivalent under the policies discussed in |151 119) . The remaining sections of 
this paper therefore aim at exploring the potential benefits of high-resolution in- 
formation on gate-release strategies: Section [2] describes a modeling approach of 
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busy airports by means of finite-state Markov Decision Processes. Section[3]then 
discusses optimal gate- and spot-release strategies and discusses the efficiency 
gains that may be expected from using high-resolution surveillance systems. 

2 Modeling busy airports by means of Markov 
Decision Processes 

To clarify the impact of added surface information on gate- and spot-release 
strategies, we study feedback control laws under various information scenarios. 
We define surface information in terms of aircraft ground position, ramp access 
to the taxiway system, and runway queue length. A stochastic model of taxi de- 
parture operations is developed by means of Markov Decision Processes (MDP) 
and Partially Observable Markov Decision Processes (POMDPs). 

2.1 Airport modeling 

Airport operations are modeled as a Markov Decision Process. The proposed 
stochastic model emulates departure surface operations when: 

• Exact aircraft positions are available, 

• Aircraft trajectories are subject to uncertainties. 

Markov Decision Processes are attractive because numerical procedures are well- 
identified to compute optimal control policies, based on linear programming. 
This is unlike the models discussed in [IS], whose resolution is finer, but which 
can be used only to simulate elementary control laws such as windowing schemes. 
The airport surface is discretized by representing it as a finite number of "boxes" , 
within which aircraft may be found. Thus, the number of aircraft locations is 
finite, and depends upon a spatial sampling of the taxiway system. At each time 
step, aircraft may move to the next available spatial sample or stay in place. 

2.1.1 Model Description 

When a clearance is issued by ground controllers, an aircraft enters the move- 
ment area at a given entry point corresponding to the terminal the aircraft 
originates from. The movement area of the taxiway-system is modeled, in this 
section, as a single taxiway. Aircraft motion along the taxiway is described by 
state transition maps, that describe the probabilities for aircraft to move for- 
ward or stay in place. When aircraft arrive at the runway threshold, they enter 
a limited capacity buffer directly servicing the runway, and the aircraft order is 
maintained on the taxiway. The take-off clearance process is then simulated as 
a steady state stochastic process using the sum of two Bernoulli variables. This 
sum provides the means to calibrate, not only the average, but also the stan- 
dard deviation of the take-off rate. It borrows from previous models [15] . The 
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uncertainty related to the take-off time illustrates the limited prediction capa- 
bilities that agents issuing ground clearances have regarding the exact take-off 
clearance time. 

2.1.2 Surface States Coding 

Each state is represented as a binary vector composed of three parts: the con- 
trol point, the taxiway, and the runway queue, as illustrated in Fig. [2] The 
control points represent the entry points of the taxiway. When a taxi clearance 
is issued, one of the control points is switched from to 1 to indicate that an 
aircraft was cleared to taxi toward the runway. The second part is the taxiway, 
which is directly connected to the control point. The taxiway is spatially sam- 
pled, with only one aircraft allowed per spatial sample. The state of the taxiway 
is represented by a binary vector of the same size as the taxiway. The vector's 
elements are set to one when the corresponding spatial sample is occupied by 
an aircraft, and zero otherwise. The runway threshold queue state is expressed 
as a binary number representing the number of aircraft in the queue. For in- 
stance, if there are 3 aircraft queueing at the runway threshold, the state of the 
queue is given by the binary vector Oil. The entire state is then obtained by 
concatenating the binary vectors of the control points, the taxiway system, and 
the runway queue. Finally, the overall binary vector is converted to a decimal 
number, which is its state identification number. For instance, in Fig. [2j the 
state vector 001001101011 is state 619, and corresponds to 3 aircraft on the 
taxiway and 3 aircraft in the runway queue. 
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Figure 2: State space model of typical airport by means of Markov decision 
processes. The airport features one runway, one taxiway and two access control 
points (spots). More sophisticated models could include several taxiways and 
runways 



2.1.3 Indices and Notations 

The state space and the state index space are linked by a bijective index function. 
In the rest of this paper, the notation i refers to the index of a state vector. 
The notation i[s] refers the s*'' component of the state vector i e 5. 

2.1.4 Model Parameters 

The system is entirely specified by the following parameters: 
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• Ls : The taxiway length represented by one spatial sample 

• Tg : The sampling time 

• N: The number of spatial samples 

• to: The probability of moving forward at the next time step 

• ci and C2'. The probability of receiving a take-off clearance for an aircraft 
at the runway threshold is determined by two Bernoulli variables with 
parameters ci and C2 

• B: The maximum capacity of the runway threshold aircraft buffer 

The model of departure operations is a Markov Decision Process. Thus, it 
is entirely defined by the probabilities to transition from a state i to another 
state J, knowing that the decision to send an aircraft on the taxiway is k (with 
k = 1 corresponding to the decision of sending the next aircraft, and k — 
corresponding to the decision of not sending an aircraft). These probabilities 
are the model transition probabilities, and are noted Pj\ik- These probabilities 
were evaluated from the parameters described above. To give some idea of 
the model complexity, a typical airport may yield about 220,000 non-trivial 
transition probabilities. 

2.1.5 Markov Decision Process: States and Transition Probabilities 

The transition probabilities are generated by enumerating through all possible 
simultaneous sub-transitions that lead to a feasible state. Sub-transitions are 
defined as atomic transitions that happen during the same time step. The 
process by which these transition probabilities are generated is tedious and the 
reader is invited to refer to ^SS^ for more details. 

2.2 Model Calibration Procedure 

The calibration of the model is based on the analysis of the selected ASPM 
data, as well as direct observations of airport satellite pictures. The following 
quantities are defined: corresponds to observations of physical distances 
between taxiing aircraft. Tg is defined as the shortest characteristic time of 
the different phenomena captured by the model. The variables N, the number 
of spatial samples of the taxiway, and to, the probability of moving forward 
when unencumbered, are calibrated using taxi statistics derived from ASPM 
data. Finally, ci, C2, which define the take-off probabilities, and B, the runway 
buffer size, are calibrated using take-off statistics coupled with estimates of the 
number of taxiing aircraft. The calibration procedure is described as it is applied 
to New- York La Guardia airport, shown in Fig.[3j Owing to the presence of two 
main terminals, the airport is represented using the Markov Decision Process 
illustrated in Fig|4] The following quantities are identified: 
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Figure 3: LaGuardia airport in most common configuration. 
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Figure 4: A model of LaGuardia as Markov Decision Process - two access ramps 
capture tfie entire terminal structure 



2.2.1 Sampling Time 

The temporal resolution of the ASPM data is one minute. Our model sampling 
frequency was set to match the sampling rate of the data against which it is 
calibrated and Tg is set to one minute. 

2.2.2 Departure Capacity 

Heavy traffic surface operations are used to evaluate the departure capacity and 
calibrate the take-off clearance variables ci and C2. Heavy traffic corresponds 
to the number of aircraft for which the average number of take-off per minute 
saturates. In the case of LaGuardia Airport, heavy traffic is achieved when 14 
or more aircraft are taxiing toward the runway. Data show that the airport 
throughput rate has a mean of 0.605 aircraft per minute and a standard devi- 
ation of 0.578 aircraft per minute when the taxiway system is saturated. The 
take-off clearances are modeled using the sum of two Bernoulli variables Ci and 
C2 of parameter 0.5140, and 0.0929, respectively (variables following a Bernoulli 
distribution of parameter p equal to 1 with success probability p and with 
failure probability 1 — p). The sum of the two random variables is evaluated 
at every minute and determines how many aircraft take off. The value of these 
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two parameters was determined by solving the following system of equations: 
Average = ci+ C2 ~ 0.605 (1) 



Std Deviation = 



Vci • (l-ci) + C2 • (I-C2) = 0.578 



(2) 



2.2.3 Taxiways 

Once the departure rate variables are calibrated, the taxiway variables N and 
m are calibrated to reproduce light-trafRc unimpeded taxi-time average, and 
standard deviation, for aircraft pushing back from each ramp area. The standard 
deviation and average of light-traffic taxi times were evaluated using the ASPM 
database. The taxi-out time is defined as the time between push-back and 
wheels-ofF and includes pushback, taxi, and waiting for take-off clearance times. 
Therefore average taxi times were computed by subtracting average pushback 
times and average take-off clearance times from average unimpeded taxi-out 
times. Likewise, taxi-time variances were computed by subtracting pushback 
time variances and take-off clearance time variance from unimpeded taxi-out 
time variances. 

• Unimpeded taxi-out times: These taxi-out times were computed by con- 
sidering taxi-out times when surrounding traffic is low. For Ramp 1, the 
average is 13.56 minutes and the standard deviation is 2.00 minutes. 

• Pushbacks: Average duration of pushback was evaluated by Delcaire and 
Feron [33] at 2 minutes. Based on the data collected in their report, it is 
fair to estimate the standard deviation of pushback duration at 80 seconds, 
or 1.33 minutes. 

• Take-off clearance: Taxi-out times include waiting times for take-off clear- 
ance at the runway threshold. However, the model calibration should not 
include the variation caused by this waiting time. In this model, the aver- 
age waiting time for one aircraft at the runway threshold before clearance 
is 1/0.605 — 1.65 minutes, and the standard deviation 1.04 minutes. 

• Taxi time: According to the above discussion, the taxi time from ramp 

1 has a standard deviation of -\/2.00^ — 1.04^ — 1.33^ = 1.07 minutes and 
an average of 13.56— 1.65 — 2 — 9.91 minutes. A similar process for Ramp 

2 yields an average taxi-out time from Ramp 2 equal to 6.4 minutes. 

The probability m of moving forward, and the number of steps N from 
each ramp to the runway threshold, were calibrated to match the average 
and standard deviation of taxi times in light traffic under nominal condi- 
tions. For Ramp 1, N and m solve the following system of equations. 



Average = — • = 9.91 minutes 
m 



(3) 



Standard Deviation = 
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Which gives, 

N = 8.88 w 9 steps 

m = 0.90 « — ^ = 0.9084. 

Average 

For Ramp 2, iV = 3 and m remains the same. 

• Cahbrating the runway buffer capacity B: The aircraft buffer at the run- 
way threshold simulates aircraft that queue closely to each other in order 
to ensure a high utilization rate. The buffer capacity must be as small as 
possible to limit the size of the state space over which optimal policies are 
computed. However, the buffer capacity needs to be large enough to allow 
ground controllers to absorb uncertainties in take-off clearance time and 
taxi time. The standard deviation yielded by the sum of these two times 
for a single aircraft is Vl.O?^ + 1.04^ = 1.49 minutes. 

The buffer was calibrated to be able, when fully loaded, to supply aircraft 
for a time close to 3 times this standard deviation, i.e. 4.47 minutes. Thus, 
the buffer size was approximated to provide enough aircraft to cover at 
least 4.47 minutes, which is 4.47/0.605 = 7.39 ~ 7 take-ff clearances. The 
capacity was set to 7 aircraft and the buffer was coded using 3 bits, as 
illustrated in Fig. [2] 

• Calibrating Lg: A 200- meter separation between taxiing aircraft was sug- 
gested in previous work on taxi operations |35l 136] . Hence, that number 
was adopted here as well. 

The calibration values for the system parameters are summarized in Table 



Table 1: Calibration values 



Calibration Variables 


Values 


Ls 


200 meters 


Ts 


60 seconds 


N 


9 (Ramp 1) 




3 (Ramp 2) 


m 


0.9084 


Cl 


0.5140 


C2 


0.0929 


B 


7 
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2.2.4 Model Validation 

Using ASPM data, La Guardia airport average tiirougiiput rate is expressed 
as a function of the number of taxiing aircraft. Tlie grapli provided in Fig. [5] 
sliows the airport throughput as a function of the number of taxiing aircraft, and 
yields the average take-off rate. Fig. [5] also shows the throughput as a function 
of the number of taxiing aircraft for the stochastic model. The model behaves 
similarly to the airport, and faithfully reproduces the queueing and stochastic 
nature of departure operations. When the number of taxiing aircraft reaches 11, 
the model saturates, and yields a maximum take-off rate distribution averaging 
0.598 aircraft per minute, with a standard deviation of 0.585 aircraft per minute. 
These are similar to the average (0.605) and the standard deviation (0.578) of the 
observed take-off rate at LaGuardia, when the taxiway is saturated by departing 
aircraft. The saturation level of the model take-off rate is reached at a lower 
number of taxiing aircraft than for the ASPM data because the model accounts 
for operations on the taxiway only from the ramp control points. By contrast, 
the ASPM data includes all aircraft on the ground starting at pushback. The 
ASPM data does not provide aircraft position, therefore it is not possible to 
distinguish aircraft still pushing back at the ramp from aircraft which are at 
the ramp exit control points. To isolate taxiway operations starting at the 
control points from the rest of the ramp operations in the ASPM data, the 
ASPM curve has been shifted to match the saturation level of both curves. For 
runway utilization rates above 30% of interest in this paper, the shift efficiently 
isolates taxiway operations starting at the control points in the ASPM data, as 
illustrated in Fig. [6] Note that the two-ramp model performs better than the 
one-ramp model. 

3 Quantitative impact of full-state information: 
Optimal control of airports represented as MDPs 

To understand and valuate the impact of aircraft position information on depar- 
ture operations, an approach based on the optimization of Markov Decision Pro- 
cesses (MDP) and Partially Observable Markov Decision Processes (POMDP) 
was developed. This approach is applied to two distinct state-based policies and 
one benchmark policy: 

• The first policy, named "optimal full state feedback" assumes that the 
state of the surface is fully available. 

• The second policy, named "estimated state feedback" assumes that the 
only part of the state of the surface is known. 

• The benchmark policy, named "threshold policy" is that used in prior 
analytical and experimental works |15l I19j . 
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Figure 5: LaGuardia throughput as a function of the number of taxiing air- 
craft, from the two ramp model and ASPM data. The ASPM data reflects all 
departure operations on the ground starting at pushback. 

3.1 Approach 

The objective of this approach is to evaluate how the level of information avail- 
able on aircraft position affects potential taxi-time reductions, for a given rate 
of runway utilization, and within a collaborative framework enabling the fine 
tuning of taxi clearances, when aircraft exit the ramp area. 

3.1.1 Assumptions 

Ground controllers operate as optimally as allowed by existing technology: they 
know the behavior of the system, and given the level of information available, 
they understand what the best policy is. Their goal is to maximize the departure 
runway utilization rate, while controlling aircraft to minimize taxi times. It is 
assumed that there is enough departure demand for FAA ground controllers to 
always have an aircraft waiting to be cleared for taxi at both ramps, since this 
corresponds to peak demand times. The aircraft is either cleared for push-back, 
if it pushes directly on the movement area, or cleared for taxi, if it has already 
pushed back on the ramp area, and is waiting at a control point to enter the 
movement area. 
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Figure 6: LaGuardia throughput as a function of the number of taxiing aircraft, 
from the two ramp model and ASPM data. The ASPM curve is shifted by 3 
aircraft to isolate taxiway operations starting at ramp exit control points, for 
utilization rates above 30%. 



3.1.2 Optimal pushback policies 

Each state has a cost, an optimal clearance policy is the set of decisions that 
minimizes the expected averaged cost over an infinite time horizon. 

3.1.3 Trade-offs and cost structure 

For each time instant i, each state i is given a cost Ci that reflects its desire- 
ability. This cost is a weighted sum of the number of taxiing aircraft Nac{i) 
and a cost attributed to the non-utilization of the runway Sr{i) multiplied by a 
constant /3. The variable Sr{i) is equal to 1 if there is no aircraft in the runway 
buffer and to if there is at least 1 aircraft. For every state i, the cost Ci 
attributed to that state is given by 

a = Nac{t)+f3-Srii). (5) 

As /3 increases, the optimal policy favors maximizing the runway utilization 
rate over minimizing the number of taxiing aircraft. /3 and Ci are expressed in 
number of aircraft per minute. /3 is the ratio of the cost of non-utilization of 
the runway for one minute over the cost of having one aircraft on the taxiway 
for one minute. 
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For each value of /3, the corresponding optimal policy is Pareto optimal and 
captures the trade-ofF between minimizing taxi time and maximizing runway 
utilization rate. 

3.1.4 Fairness considerations when multiple ramps are present 

It is assumed that each terminal (ramp) has aircraft ready to enter the taxi- 
way system, and that they must be serviced fairly. Two mechanisms have been 
introduced for that purpose: In ramp alternation, the policy must service each 
ramp once at a time. An additional state is introduced in the Markov Deci- 
sion process to reflect this. In statistical fairness, a constraint is introduced to 
constrain each ramp to be serviced an equal number of times on average. 

3.2 Information valuation 

The metrics used to value information are runway utilization and number of 
taxiing aircraft. The value of added information is computed as the improve- 
ment in closed-loop system performance generated by this added information. 

3.2.1 Full State Feedback and optimal policies 

Under full state feedback, the agent controlling the clearances can fully observe 
state of the surface state. The optimal decision fc is a function of the observed 
state i. Given the cost structure and the representation of the airport taxi-out 
process as a Markov Decision Process, it is possible to use linear optimization 
techniques to find the steady-state optimal decision policy 11 that minimizes the 
expected cost per time step |37]. If i{t) is the state at time t, then 

Expected Cost = lim £; f - • V du) | . (6) 

To detail the optimal control approach, we use the following notations: 

• Let i be the state at time n. 

• Let 77 be the state at time n-l-1. 

• Let K be the decision variable value at time n. 

• Let j/ifc = P{l, — i, k = k) he the probability of being in state i and 
taking decision k. The optimal decision k is given by the optimal policy: 

k = n(i). 

• Let Pj\ik = P{ri ~ j|t = i, K = k) he the probability of having the next 
state j knowing the current state is i and the decision chosen is k. 

item In addition, a state is added that describes whether the next pushback 
originates from ramp 1 or ramp 2 
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For a steady state process with M + 1 states and K decisions, the expected 
cost per time step is [37] 



Urn E{- ■ J2 c^(t)) - E E ^^'^ ■ y^'^- (7) 

t=0 1=0 = l 

Consequently, the cost function for this hnear optimization is 

M K 

Minimize Z ^^^dk ■ y^k- (8) 

i=0 k=l 

Subject to: 

1. Constraints on state-decision probabihty variables: 

M K 

EE^^^'^^i (9) 

i=0 fc=l 



> 0,for i = O..M;fc = (10) 
2. Constraints governing state transitions: 

K M K 

^yjk-^^yik■PJ\^k = ^, (11) 

k=l i=0 fc=l 

for j = 0..M; fc = l..i^ 

Once the optimal set of steady state probabilities of being in state i and 
taking decision fc, j/i^, is evaluated and the corresponding optimal pushback 
policy is given by 

if Uik > then 11^ = 1 else if y^fe = then Ui = (12) 

3.2.2 Partial information: Estimated State Feedback 

In this scenario, the agent has access to the number of taxiing aircraft, and he 
knows whether or not it is physically possible to clear an aircraft (there may be 
another aircraft in the way). In real-life situations, this partial information is 
always available because ramp controllers keep track of the number of aircraft 
that have pushed back, and the number of aircraft that have taken-off. In addi- 
tion, communication technologies ensure simple Input-Ouput information is eas- 
ily available. For instance. Aircraft Communications Addressing and Reporting 
System (ACARS) is a digital datalink system for transmission of short relatively 
simple messages between aircraft and ground stations via radio or satellite and 
provides aircraft take-off times. Under limited aircraft position information. 
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the system becomes a Partially Observable Decision Process (POMDP). There 
exists several methods to solve POMDPs optimally [Ml EH SOI SI]- These 
methods are computationally very demanding for a finite time horizon, and not 
appropriate for an infinite time horizon. Indeed, finite-horizon POMDPs are 
PSPACE-complete [H] and infinite-horizon POMDPs are undecidable [15] . 

Most Likely State For these reasons, methods applicable to an infinite time 
horizon and computationally more tractable were considered [35]. The Markov 
process that is modeled for LaGuardia includes more than 220,000 transitions 
with non-zero probabilities. Heuristic methods are computationally faster, and 
better suited to determine effective control laws for this POMDP. Among these, 
the Most Likely State (MLS) algorithm was selected because it is applicable to 
an infinite time horizon and compares favorably with other effective heuristic 
algorithms [SS]. Moreover, its steps resemble the behavior of a decision maker 
under uncertainty. Indeed, this heuristic control strategy consists of estimating 
the most likely current state, and choosing the corresponding optimal decision, 
using the optimal decision policy evaluated in the full state feedback case. Fig. 
[7] illustrates the information available to the decision maker. 




Figure 7: Estimation of the taxiway system state by a decision maker 

The variables used in the MLS algorithm are defined as follow: 

• Let O designate the index of the current observation. The current obser- 
vation is the number of taxiing aircraft and wether or not it is physically 
possible to clear an additional aircraft for pushback or taxi. 

• Let bi be the probability of being in state i for all states i of the state 
space, b is the belief state vector. 

• Let Po\j — P{Q — o|r/ = j) be the probability of observing o, knowing the 
current state is j, for all observations o in the observation space, and for 
all states j in the state space. 
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The updater function takes the previous behef state b, the current observation 
o, the previous decision fc, and returns the current belief state vector b' . 
The following equation is derived from Bayes' rules [44] : 



M 



6'. 



3 M M 
j=0 i=0 



(13) 



Fig. |8]details the heuristic control of taxi clearance decisions based on partial 
observations. 
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Figure 8: Heuristic control of taxi clearance decisions based on partial observa- 
tion 



Observation probability matrix This paragraph details how observations 
are defined and how the probability matrix p^y is evaluated. The information 
contained in an observation is given by the probability matrix Po\j- This prob- 
ability is key to evaluate the probability of having every state j given a specific 
observation o and previous belief b. Eq. ( 13 1 explains how observations of the 
surface are incorporated into the decision process during the update of the belief 
state. 

Let O be the observation space and c be the total number of components, 
or piece of information, included in each observation o € O. Then O is a subset 
of Si*^. In this scenario there are two pieces of information, c = 2, the number 
of taxiing aircraft Nac, and whether or not it is physically possible to clear 
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an aircraft using {RampFree), a binary variable. An observation is a vector 
defined by 



o = [Nac RampFree] . (14) 

The algorithm generating the observation probability matrix uses an injec- 
tive function, which attributes a unique observation index n(o) to every observa- 
tion o. The injective function converts the observation vector with 2 components 
into a binary vector of [roundup{log2{max{Nmac)))^-roundup[log2{rnax{RarnpFree))y\ 



bits to then reconvert it back to its decimal value, as illustrated in Eq. (15). 



n{o) = bin2dec{\dec2hin{N ac) dec2bin{RampFree)\) (15) 

For any state j, there exists only one information that can be observed 
o(j), consequently for a system with N possible observations and M states, 
observation probabilities are zeros and ones, i.e. V(o„,j) G {l..A^} x {1..M}, 



Pon\j G 0, 1. Eq. (16) shows how the p^^j matrix is evaluated. 



j 1 if o„ = n(o(j) , 
if o„ 7^ n{o[])). 



3.2.3 Threshold policy 

A threshold policy is a pushback control law, which relies solely on the current 
number of taxiing aircraft to make a push-back decision and is described in [TSl 
119) . This simple control law computes the number of taxiing aircraft N{i) for 
state i and compares it to a given threshold value Th [15]. If the number of 
aircraft is greater than the threshold, no pushback clearance is issued, and fc = 0. 
On the other hand, if that number is smaller than the threshold, a pushback 



clearance is issued, and k — 1. This is summarized by the following Eq. (17), 



ydiiN{i)<Th. ^ ' 

Note that the threshold policy can be evaluated analytically since the cor- 
responding closed-loop system is a Markov chain. When multiple ramps are 
present, the threshold policy is required to alternate evenly among the ramps. 



3.3 Optimal policies against benchmark policy: New York 
La Guardia airport 

Fig. [9] illustrates the utilization rate of the LaGuardia Airport two ramp model 
as a function of the average number of taxiing aircraft. Fig. [lO] shows the reduc- 
tion in percent of the average number of taxiing aircraft for optimal policies, as 
a function of the utilization rate, when compared with a threshold policy which 
alternates between ramp one and ramp two. 
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Figure 9: Runway utilization rate as a function of the average number of taxiing 
aircraft at LaGuardia Airport 



When the number of taxiing aircraft is Umitcd to one aircraft by the thresh- 
old policy, the difference of performance between the full-state feedback policy 



and the threshold policy is inexistent, as illustrated by Fig. 10 This confirms 
the intuition that there is no benefit in knowing the exact position of aircraft 
when there can be no conflict between aircraft on the taxiway. 

When the threshold for the number of taxiing aircraft is increased to two 
and and then three, the threshold policy starts yielding a lower utilization rate 
for the same number of taxiing aircraft than the full-state feedback policy, as 
shown in Fig. |9] and 10 Indeed, the threshold policy releases aircraft blindly, 
based on the number of taxiing aircraft. Consequently aircraft have a higher 
probability of conflicting with each other on the taxiway. The optimal full-state 
feedback policy performs better because it manages the release of aircraft using 
the exact position of the other aircraft already taxiing. 

Among the two fairness rules described above, the policy based on statistical 
fairness yields the best results, as shown in Fig. [Toj However, it performs close 
to the policy that strictly alternates between ramps. It is noticeable that the 
simulation of the statistical fairness optimal policy, produces performances that 
are slightly worse than those directly indicated by the optimization software 
output. Consistent with the reliability analysis, there is a sharp divergence of 
reliability when the runway utilization rate exceeds 0.98. 

The full state feedback policies perform consistently better, generating a 
smaller average number of taxiing aircraft, when compared with the threshold 
benchmark policy. This performance is consistently better over a wide array 
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Figure 10: Reduction in percent of the average number of taxiing aircraft as a 
function of the utihzation rate, when compared with a threshold policy which 
alternates between ramp one and ramp two. 



of runway utilization rates, which correspond not only to intermediate runway 
capacities, but also to situations where the runway is used at maximum capacity. 
For rates between 0.6 and 1, the reduction of the number of taxiing aircraft is 
consistently above 3.5 percent. Most interestingly, as the runway utilization 
rate increases from 0.92 to 0.96, the savings reach 4 percent. 

3.4 Extensions 

The methodology presented here has been extended to other airports with sim- 
ple runway /taxi way structures. Considering Seattle- Tacoma airport (SEA), a 
similar modeling approach, followed by optimal control policies, has allowed us 
to evaluate the savings (in terms of reduced emissions, or number of aircraft 
on the airport surface during busy hours) at approximately 6% compared with 
threshold approaches currently under evaluation. 

Extensions of this work to large airports featuring multiple terminals, taxi- 
ways and runways are possible. However, several challenges must then be ad- 
dressed. First, extensive, high-resolution datasets must be available to the user 
for model calibration. Unlike the ACARS data, which are sufhcient for the 
calibration of simple airport dynamics, more extensive datasets, such as those 
generated by surface monitoring systems such as ASDE-X are unlikely to be 
as easy to manipulate. Second, the design of optimal control policies requires 
the solution of linear programs whose size, commensurate with the underlying 
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state-spaces, largely exceeds existing computational capabilities. As a result, 
alternative design techniques may need using, such as approximate dynamic 
programming techniques |45) . 

4 Conclusions 

This paper assesses the benefits of providing surface surveillance information to 
the ramp clearance control process at busy airports. 

Our results have shown that, within a collaborative framework allowing the 
creation of a virtual queue, surface surveillance information can significantly 
improve the control of stochastic departure operations on the ground. More 
specifically, at LaGuardia airport, controlling taxi clearances optimally using 
surface surveillance reduces the number of taxiing aircraft by 4% when the 
airport functions near capacity, compared with a threshold policy which limits 
the number of taxiing aircraft. At Seattle airport, controlling taxi clearances 
optimally using surface surveillance reduces the number of taxiing aircraft by 
6% when the airport functions near capacity, compared with a threshold policy 
which limits the number of taxiing aircraft. It has been observed that, in order 
to minimize wasteful surface conflicts and queues, the optimal full-state feedback 
policy relies on aircraft position information to avoid conflicts, maximize runway 
utilization, and balance and coordinate ramp taxi clearances. 
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